Mobility sound generation apparatus and method thereof

ABSTRACT

A mobility sound generation apparatus of generating a sound suitable for a landscape while driving of a mobility may include an information acquisition device provided in a mobility to acquire information on an outside landscape of the mobility while driving of the mobility; a sound generation device configured to generate a sound corresponding to the information on the outside landscape; and a sound output device configured to output the generated sound, whereby it is possible to acquire information on an outside landscape while driving of the mobility and generate a sound corresponding to the information on the outside landscape and it is possible for facilitating an occupant to admire a landscape by expressing the outside landscape with sound while driving to generate and provide the sound corresponding to water, mountains, buildings or the like forming the outside landscape of the mobility.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority to Korean Patent Application No.10-2021-0062111, filed on May 13, 2021, the entire contents of which isincorporated herein for all purposes by this reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to a mobility sound generation apparatusand a method thereof, and more particularly, to a mobility soundgeneration apparatus that generates a sound suitable for landscape whiledriving and a method thereof.

Description of Related Art

A driver of a mobility can enjoy landscape as the outside landscapechanges frequently while driving. However, other occupants who aresleeping in the mobility or the visually impaired cannot feel theoutside landscape while driving the mobility. Furthermore, occupants whoare in positions where the window of the mobility cannot be seen alsocannot admire the outside landscape, and even if the window is visible,the outside landscape is partially blocked, so that occupants cannotfully appreciate the outside landscape.

Furthermore, as elements forming a sound, there may be an equalizer, asound volume, a beat, and the like. By utilizing these elements, thedemand for technology for generating and expressing an outside landscapeof a mobility with sound is emerging.

The information disclosed in this Background of the Invention section isonly for enhancement of understanding of the general background of theinvention and may not be taken as an acknowledgement or any form ofsuggestion that this information forms the prior art already known to aperson skilled in the art.

BRIEF SUMMARY

Various aspects of the present invention are directed to providing amobility sound generation apparatus of generating a sound suitable for alandscape while driving and a method thereof.

Various aspects of the present invention provide a mobility soundgeneration apparatus of generating a sound expressing weather whiledriving of a mobility to enable an occupant of the mobility to recognizeweather outside the mobility and a method thereof.

Various aspects of the present invention provide a mobility soundgeneration apparatus of generating and providing a sound correspondingto water, mountains, buildings, or the like forming a landscape outsidethe mobility, expressing the outside landscape with the sound whiledriving to generate a driving environment for facilitating an occupantto enjoy the outside landscape and a method thereof.

Various aspects of the present invention provide a mobility soundgeneration apparatus of dynamically expressing an external environmentwith sound by providing different sound beats according to mobility,bike, person, or the like existing in the vicinity of the mobility whiledriving and a method thereof.

Various aspects of the present invention provide a mobility soundgeneration apparatus of generating tension while driving by expressing adegree of congestion around mobility with sound and a method thereof.

The technical problems of the present invention are not limited to theaforementioned problems, and any other technical problems not mentionedherein will be clearly understood from the following description bythose skilled in the art.

The technical problems to be solved by the present inventive concept arenot limited to the aforementioned problems, and any other technicalproblems not mentioned herein will be clearly understood from thefollowing description by those skilled in the art to which variousexemplary embodiments of the present invention pertains.

According to various aspects of the present invention, a mobility soundgeneration apparatus includes an information acquisition device which isprovided in a mobility to acquire information on an outside landscapewhile driving of the mobility, a sound generation device that generatesa sound corresponding to the information on the outside landscape, and asound output device that outputs the generated sound.

The information acquisition device may acquire the information on theoutside landscape though a navigation map of the mobility and at least acamera provided in the mobility.

The sound generation device may set a background sound based on a ratioof a preset first category item occupying the outside landscape.

The preset first category item may include at least one of mobility,buildings, water, persons and mountains.

The sound generation device may determine a ratio of sound volumes forfrequency bands based on a weather.

The sound generation device may generate an image corresponding to theweather, and determine the ratio of sound volumes for frequency bandscorresponding to the image.

The information acquisition device may acquire an external image througha camera provided in the mobility, and the sound generation device maydetect an image information corresponding to a preset second categoryitem in the external image, and generate a beat according to thedetected preset second category item.

The sound generation device may determine a speed of the beat accordingto a type of the detected preset second category item.

The sound generation device may determine a sound volume of the beataccording to a density of the detected preset second category item.

The preset second category item may include at least a vehicle, aheterogeneous mobility, and a person.

The sound generation device may set a background sound based on abackground sound used in a previous driving when it is determined basedon navigation information of the mobility that a path through which themobility is to drive includes a path through which the mobility hasdriven previously.

According to various aspects of the present invention, a mobility soundgeneration method includes acquiring, by an information acquisitiondevice provided in a mobility, information on an outside landscape whiledriving of the mobility, and generating, by the sound generation device,a sound corresponding to the information on the outside landscape.

The generating, by the sound generation device, of the soundcorresponding to the information on the outside landscape may includesetting, by the sound generation device, a background sound based on aratio of a preset first category item occupying the outside landscape.

The generating, by the sound generation device, of the soundcorresponding to the information on the outside landscape may includedetermining, by the sound generation device, a ratio of sound volumesfor frequency bands based on a weather.

The determining, by the sound generation device, of the ratio of soundvolumes for frequency bands based on the weather may include generating,by the sound generation device, an image corresponding to the weather,and determining, by the sound generation device, the ratio of soundvolumes for frequency bands corresponding to the image.

The acquiring, by the information acquisition device, of the informationon the outside landscape during the driving of the mobility may includeacquiring, by the information acquisition device, an external imagethrough a camera provided in the mobility.

The generating, by the sound generation device, of the soundcorresponding to the information on the outside landscape may includedetecting, by the sound generation device, an image informationcorresponding to a preset second category item in the external image;and generating, by the sound generation device, a beat according to thedetected preset second category item.

The generating of the beat based on the detected preset second categoryitem may include at least one of generating, by the sound generationdevice, a speed of the beat according to a type of the detected presetsecond category item, and determining, by the sound generation device, asound volume of the beat according to a density of the detected presetsecond category item.

The generating, by the sound generation device, of the soundcorresponding to the information on the outside landscape may includesetting, by the sound generation device, a background sound based on thebackground sound used in a previous driving when it is determined basedon navigation information of the mobility that a path through which themobility is to drive includes a path through which the mobility hasdriven previously.

The methods and apparatuses of the present invention have other featuresand advantages which will be apparent from or are set forth in moredetail in the accompanying drawings, which are incorporated herein, andthe following Detailed Description, which together serve to explaincertain principles of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an apparatus of generating asound for mobility according to various exemplary embodiments of thepresent invention.

FIG. 2 is a block diagram illustrating a mobility sound generationsystem according to various exemplary embodiments of the presentinvention.

FIG. 3 is a diagram illustrating operations of components of a mobilitysound generation apparatus according to various exemplary embodiments ofthe present invention.

FIG. 4 is a diagram illustrating that a mobility sound generationapparatus according to various exemplary embodiments of the presentinvention generates a sound according to weather and first categoryitems.

FIG. 5 is a diagram illustrating that a mobility sound generationapparatus according to various exemplary embodiments of the presentinvention generates a sound according to second category items.

FIG. 6 is a flowchart illustrating an operation of a mobility soundgeneration apparatus according to various exemplary embodiments of thepresent invention.

FIG. 7 is a flowchart of a mobility sound generation method according tovarious exemplary embodiments of the present invention.

It may be understood that the appended drawings are not necessarily toscale, presenting a somewhat simplified representation of variousfeatures illustrative of the basic principles of the present invention.The specific design features of the present invention as includedherein, including, for example, specific dimensions, orientations,locations, and shapes will be determined in part by the particularlyintended application and use environment.

In the figures, reference numbers refer to the same or equivalent partsof the present invention throughout the several figures of the drawing.

DETAILED DESCRIPTION

Reference will now be made in detail to various embodiments of thepresent invention(s), examples of which are illustrated in theaccompanying drawings and described below. While the presentinvention(s) will be described in conjunction with exemplary embodimentsof the present invention, it will be understood that the presentdescription is not intended to limit the present invention(s) to thoseexemplary embodiments. On the other hand, the present invention(s)is/are intended to cover not only the exemplary embodiments of thepresent invention, but also various alternatives, modifications,equivalents and other embodiments, which may be included within thespirit and scope of the present invention as defined by the appendedclaims.

Hereinafter, various exemplary embodiments of the present invention willbe described in detail with reference to the exemplary drawings. Inadding the reference numerals to the components of each drawing, itshould be noted that the identical or equivalent component is designatedby the identical numeral even when they are displayed on other drawings.Furthermore, in describing the exemplary embodiment of the presentinvention, a detailed description of well-known features or functionswill be ruled out in order not to unnecessarily obscure the gist of thepresent invention.

In describing the components of the exemplary embodiment according tovarious exemplary embodiments of the present invention, terms such asfirst, second, “A”, “B”, (a), (b), and the like may be used. These termsare merely intended to distinguish one component from another component,and the terms do not limit the nature, sequence or order of theconstituent components. Unless otherwise defined, all terms used herein,including technical or scientific terms, have the same meanings as thosegenerally understood by those skilled in the art to which variousexemplary embodiments of the present invention pertains. Such terms asthose defined in a generally used dictionary are to be interpreted ashaving meanings equal to the contextual meanings in the relevant fieldof art, and are not to be interpreted as having ideal or excessivelyformal meanings unless clearly defined as having such in the presentapplication.

Hereinafter, embodiments of the present invention will be described indetail with reference to FIGS. 1 to 7.

FIG. 1 is a block diagram illustrating a mobility sound generationapparatus according to various exemplary embodiments of the presentinvention.

Referring to FIG. 1, a mobility sound generation apparatus 100 mayinclude an information acquisition device 110, a sound generation device120, and a sound output device 130.

The mobility described in various exemplary embodiments of the presentinvention may refer to a transport means including a vehicle.

The mobility sound generation apparatus 100 according to variousexemplary embodiments of the present invention may be implemented insideor outside the mobility. In the present case, the mobility soundgeneration apparatus 100 may be integrally formed with the internalcontrol units of the mobility, or may be implemented as a separatehardware device and connected to the control units of the mobilitythrough connection means.

As an example, the mobility sound generation apparatus 100 may beimplemented integrally with a mobility, may be implemented to beinstalled/attached to a mobility as a configuration separate from themobility, or some components thereof may be implemented integrally withmobility and the other components may be implemented to beinstalled/attached to the mobility as a configuration separate from themobility.

The information acquisition device 110 may be provided in the mobilityto acquire information on an outside landscape while driving of themobility.

For example, the information acquisition device 110 may acquireinformation on the landscape through a navigation map of the mobilityand a camera provided in the mobility.

As an example, the information acquisition device 110 may identify itemsincluded in a landscape of an area, in which the mobility is driving,through the navigation map of the mobility.

For example, the information acquisition device 110 may acquireinformation on whether water, mountains, buildings, or the like exist inan area in which the mobility is driving through the navigation map ofthe mobility.

The information acquisition device 110 may acquire information onwhether water, mountains, buildings, or the like exist in an area inwhich the mobility is driving or how much water, mountains, buildings,or the like occupy the landscape visible from the mobility, if existing,through the navigation map of the mobility.

Furthermore, the information acquisition device 110 may acquireinformation on whether there is a previous driving history for a path onwhich the mobility is driving through the navigation map of themobility.

For example, the information acquisition device 110 may acquire anexternal image through a camera provided in the mobility.

For example, the information acquisition device 110 may determine whichclassification items are included in the external landscape of themobility through the external image acquired through the camera providedin the mobility.

As an example, the classification items may include a first categoryitem and a second category item.

The preset first category item may include items corresponding tomountains, water, buildings, and the like forming the background of thelandscape.

As an example, the first category items may include items that changewhen moving to another area after driving for a relatively long time,not items of small units such as mobility and people that change in realtime in the external landscape according to the driving of mobility.

The second category item may include items corresponding to externalvehicles, heterogeneous mobility, persons, or the like that change inreal time in the external landscape.

As an example, the second category item may include items of small unitssuch as mobility and persons that change in a relatively short time unitin the external landscape according to the driving of the mobility.

As an example, the information acquisition device 110 may be directly orindirectly connected to the sound generation device 120 through wirelessor wired communication to transmit the acquired information on theoutside landscape while driving of the mobility to the sound generationdevice 120.

The sound generation device 120 may generate a sound corresponding tothe information on the landscape.

For example, the sound generation device 120 may generate a soundincluding a background sound corresponding to the information on thelandscape, a beat, and an equalizer.

For example, the sound generation device 120 may set the backgroundsound based on the ratio of the preset first category items occupyingthe landscape.

As an example, the preset first category item may include itemsincluding at least one of mobility, buildings, water, persons, andmountains.

For example, the sound generation device 120 may acquire information onthe ratio of first category items occupying a background forming thelandscape of an area through the characteristics of the area in whichthe mobility is driving through the navigation map.

Here, the ratio of the first category items occupying the backgroundforming the landscape may be obtained as a ratio that allows a specificlevel of error and not as an accurate ratio.

As various exemplary embodiments of the present invention, the soundgeneration device 120 may acquire information on a ratio of firstcategory items occupying a background forming a landscape based on animage acquired through a camera provided in the mobility.

For example, the sound generation device 120 may determine the ratio ofa sound volume for each frequency band based on a weather.

As an example, the sound generation device 120 may acquire weatherinformation through Audio, Video, Navigation (AVN) of the mobility or byreceiving the weather information from an outside server.

As an example, the sound generation device 120 may generate an imagecorresponding to weather and determine a ratio of a sound volume foreach frequency band corresponding to the image.

For example, the sound generation device 120 may classify the weatherinto items including at least one of sunny, cloudy, rain, snow, andslightly cloudy.

A process of generating an image corresponding to the weather anddetermining the ratio of a sound volume for each frequency bandcorresponding to the image in the sound generation device 120 will bedescribed in detail later with reference to FIG. 4.

As an example, the sound generation device 120 may detect an imageportion corresponding to a preset second category item from an externalimage, and generate a beat according to the detected preset secondcategory item.

For example, the sound generation device 120 may analyze an externalimage of the mobility, acquired through the camera, to detect a presetsecond category item.

As an example, the sound generation device 120 may analyze the externalimage of the mobility, acquired through the camera, to determine thetypes and number of preset second category items.

As an example, the preset second category items may include itemsincluding at least a vehicle, a heterogeneous mobility, and a person.

Here, the heterogeneous mobility may include other types of mobility,such as a two-wheeled vehicle and personal mobility, rather than avehicle.

For example, the sound generation device 120 may determine a beat speedbased on the detected type of the preset second category item.

As an example, the sound generation device 120 may determine a soundvolume of a beat based on the density of detected preset second categoryitems.

A process of determining a speed of a beat based on the detected type ofthe preset second category item and determining the sound volume of thebeat based on the density of the detected preset second category item inthe sound generation device 120 will be described in detail below withreference to FIG. 5.

For example, when it is determined based on navigation information ofthe mobility that a path along which the mobility is to drive includes apath along which the mobility has driven previously, the soundgeneration device 120 may set a background sound based on the backgroundsound used in the previous driving.

As an example, the sound generation device 120 may determine whether apath along which the mobility is to drive includes a path along whichthe mobility has driven based on the navigation information of themobility, and when the path along which the mobility is to driveincludes the path along which the mobility has driven, set a backgroundsound to the background sound generated in the path along which themobility has driven.

The sound generation device 120 may be directly or indirectly connectedto the sound output device 130 through wireless or wired communicationto transmit information on the generated sound to the sound outputdevice 130.

The sound output device 130 may output the generated sound.

For example, the sound output device 130 may include a mobility audiospeaker or an AVN speaker, and may output the generated sound throughthe mobility audio speaker or the AVN speaker.

By outputting a sound corresponding to a landscape through the soundoutput device 130, even visually-impaired persons may identify theoutside landscape or traffic situation when a mobility is currentlydriving, achieving driving pleasure.

FIG. 2 is a block diagram illustrating a mobility sound generationsystem according to various exemplary embodiments of the presentinvention.

Referring to FIG. 2, a mobility sound generation system 200 may includea mobility 210 and a mobility sound generation server 220.

The mobility 210 may include an information acquisition device thatacquires information on an outside landscape while driving of themobility and a sound output device that outputs a sound.

For example, the information acquisition device and the sound outputdevice included in the mobility 210 are the same as the informationacquisition device 110 and the sound output device 130 of FIG. 1,respectively, and a detailed description thereof will be omitted.

However, in the mobility sound generation system 200 of FIG. 2, thefunction of the sound generation device 120 of FIG. 1, which generates asound for the mobility may be performed by the mobility sound generationserver 220.

For example, the information acquisition device may transmit theacquired information on the outside landscape while driving, to themobility sound generation server 220 through a communication circuitprovided in the mobility.

The mobility sound generation server 220 may generate a soundcorresponding to the information on the landscape obtained from theinformation acquisition device.

The process of generating a sound corresponding to the information onthe landscape in the mobility sound generation server 220 is the same asthe process of generating a sound corresponding to the information onthe landscape in the sound generation device 120 in FIG. 1 and thus adescription thereof will be omitted.

For example, the mobility sound generation server 220 may transmitinformation on the sound generated to the mobility 210 through acommunication circuit provided in the server.

FIG. 3 is a diagram illustrating operations of components of a mobilitysound generation apparatus according to various exemplary embodiments ofthe present invention.

Referring to FIG. 3, a mobility sound generation apparatus 300 mayinclude an information acquisition device 304 and a sound generationdevice 305.

Also, the mobility sound generation apparatus 300 may communicate with aserver 301 and a mobility audio speaker 310 to transmit/receiveinformation or commands.

The server 301 may include a server that overall manages a mobility, ora server that manages sound generation of the mobility.

Weather information may be provided to the mobility sound generationapparatus 300, and a background sound, an equalizer, and beat samplesnecessary for the sound generation device 305 to generate a sound may beprovided.

The information acquisition device 304 may acquire information on alandscape while driving, based on information on navigation map 302 ofthe mobility and image information acquired through a camera 303provided in the mobility.

For example, the information acquisition device 304 may determinewhether there is a previous driving history in an area in which themobility is driving, based on the information on the navigation map 302of the mobility, and when there is a previous driving history, acquireinformation on the landscape acquired in a previous driving by loadingthe information stored.

For example, the information acquisition device 304 may identify an areain which the mobility is driving based on the information on thenavigation map 302 of the mobility, and acquire information onenvironment such as mountains, water, and buildings forming thelandscape of the area.

For example, the information acquisition device 304 may detect a portioncorresponding to a first category item and a second category item in thereal-time landscape based on the image information acquired through thecamera 303 provided in the mobility while driving.

For example, the information acquisition device 304 may detect a portioncorresponding to a first category item, such as mountains, water,buildings, or the like in the real-time landscape based on the imageinformation acquired through the camera 303 provided in the mobilitywhile driving.

For example, the information acquisition device 304 may detect a portioncorresponding to a second category item, such as other vehicles,heterogeneous mobility, persons, or the like in the real-time landscapebased on the image information acquired through the camera 303 providedin the mobility while driving.

For example, the information acquisition device 304 may use a deeplearning-based object detection algorithm to detect portionscorresponding to the first category items and the second category itemsin the real-time landscape while driving.

The sound generation device 305 may perform first category analysis 306,second category analysis 307, audio analysis 308, and sound samplereproduction variable setting 309.

For example, the sound generation device 305 may perform the firstcategory analysis 306 by determining the proportion of objectscorresponding to the first category items in the landscape whiledriving.

For example, the sound generation device 305 may generate a backgroundsound by mixing background sounds corresponding to objects respectivelycorresponding to first category items in various forms according to theproportions of objects respectively corresponding to the first categoryitems in the landscape while driving.

As an example, the sound generation device 305 may determine a speed ofmovement according to the types of objects corresponding to the secondcategory items in the landscape while driving, determine a density ofthe objects, and perform the second category analysis 307.

For example, the sound generation device 305 may generate a faster beatas the speed of movement according to the type of objects correspondingto the second category item increases.

For example, the sound generation device 305 may generate a beat havinga larger sound volume as the density of objects corresponding to thesecond category items increases.

For example, the sound generation device 305 may select an equalizeraccording to current weather, and when there is a previous drivingrecord in a location in which the mobility is driving, perform the audioanalysis 308 by reflecting a sound in the case of the previous driving.

For example, the sound generation device 305 may generate a sound by useof a background sound used in the case of previous driving as abackground sound during current driving.

For example, the sound generation device 305 may perform the soundsample reproduction variable setting 309 based on results of the firstcategory analysis 306, the second category analysis 307, and the audioanalysis 308.

For example, the sound generation device 305 may set reproductionvariables such as an equalizer, a sound volume, a sound speed for asound sample received from the server 301 based on the results of thefirst category analysis 306, the second category analysis 307, and theaudio analysis 308.

The sound generation device 305 may transmit information on thegenerated sound to the mobility audio speaker 310 to output thegenerated sound through the mobility audio speaker 310.

FIG. 4 is a diagram illustrating that a mobility sound generationapparatus according to various exemplary embodiments of the presentinvention generates a sound according to weather and first categoryitems.

In FIG. 4, (i) shows items for classifying weather.

For example, the mobility sound generation apparatus 100 or 300 mayselect a weather classification item corresponding to current weather.

As an example, the weather classification item may include sunny,cloudy, rain, snow, slightly cloudy, thunder, lightning, and the like.

For example, the mobility sound generation apparatus 100 or 300 maygenerate an image according to the weather classification itemcorresponding to the current weather.

As an example, the mobility sound generation apparatus 100 or 300 maygenerate an image corresponding to the weather classification item.

For example, the image corresponding to the weather classification itemmay include a circle, a square, a rectangle, a water droplet shape, arhombus, and the like.

For example, the image corresponding to the weather classification itemmay be stored in the mobility sound generation apparatus 100 or 300 in aform of a table, and the mobility sound generation apparatus 100 or 300may select an image according to the weather classification itemcorresponding to the current weather through the table.

The mobility sound generation apparatus 100 or 300 may determine a soundvolume ratio (equalizer) of frequency bands of a sound corresponding toan image.

The mobility sound generation apparatus 100 or 300 may perform anequalizer function of sound generation by determining a volume levelratio of frequency bands of 60 Hz, 230 Hz, 910 Hz, 3.6 kHz, and 14 kHzof the sound.

As an example, the mobility sound generation apparatus 100 or 300 mayperform Fourier transform on features of a shape of an image to match atone of music.

For example, the mobility sound generation apparatus 100 or 300 maymatch a center portion of an image obtained by performing imageprocessing through a Fourier transform on the image corresponding toweather to a low frequency and match an edge of the image to a highfrequency.

The mobility sound generation apparatus 100 or 300 may divide the imageinto five portions with respect to the center portion of the imageobtained by performing image processing through Fourier transform on theimage corresponding to the weather and determine the volume level ratioof the frequency bands of 60 Hz, 230 Hz, 910 Hz, 3.6 kHz, and 14 kHz ofthe sound according to the ratio by summing up the energy valuesrespectively corresponding to the portions of the image.

Here, the frequency bands of 60 Hz, 230 Hz, 910 Hz, 3.6 kHz, and 14 kHzare arbitrarily determined frequencies for the sake of example, and mayactually be determined to other frequency values.

In FIG. 4, (ii) shows first category items.

As an example, the preset first category item may include water,mountains, and buildings.

The mobility sound generation apparatus 100 or 300 may identify a firstcategory item of a landscape while driving through a navigation deviceof the mobility or a camera provided in the mobility.

For example, the mobility sound generation apparatus 100 or 300 maydetect a first category item based on an area within a radius of 1 km inthe driving direction through a camera provided on the front portion ofthe mobility.

Here, the distance of 1 km is an arbitrarily determined distance for thesake of example, and may practically be set to a different value.

As an example, the mobility sound generation apparatus 100 or 300 maygenerate a background sound by mixing background sounds according to theratio of the first category items detected in the landscape whiledriving, based on the background sound corresponding to the preset firstcategory items.

FIG. 5 is a diagram illustrating that a mobility sound generationapparatus according to various exemplary embodiments of the presentinvention generates a sound according to second category items.

In FIG. 5, (i) shows vehicles, heterogeneous mobility, and personscorresponding to second category items in the order of movement speeds.

As an example, the mobility sound generation apparatus 100 or 300 maydetect an object corresponding to a second category item from imagesacquired through cameras provided in the front portion and rear portionof the mobility.

The mobility sound generation apparatus 100 or 300 may store informationon the movement speeds of the second category items in advance.

The mobility sound generation apparatus 100 and 300 may determine themovement speed of the type of an object corresponding to a secondcategory item found in landscape while driving, and generate a fasterbeat as the movement speed of the type of the object corresponding tothe classification item increases or a slower beat as the movement speedof the type of the object corresponding to the classification itemdecreases.

For example, the mobility sound generation apparatus 100 or 300 may seta basic speed beat according to the type of an object corresponding to asecond category item found in a landscape while driving, and modify abeat speed in a response to the speed of an object corresponding to thesecond category item determined through an image obtained in real time.

In FIG. 5, (ii) shows vehicles, heterogeneous mobility, and personscorresponding to the second category items in the order of the densitythereof.

As an example, the mobility sound generation apparatus 100 or 300 maydetermine the density of an object corresponding to a second categoryitem from images acquired through cameras provided in the front portionand rear portion of the mobility.

As an example, the mobility sound generation apparatus 100 or 300 maydetermine the density around the mobility in consideration of the sizeand number of objects of a second category item detected in an imageobtained through the camera.

The mobility sound generation apparatus 100 or 300 may generate a beathaving a smaller sound volume as the density around the mobility islower, and may generate a beat having a larger sound as the densityaround the mobility is higher.

FIG. 6 is a flowchart illustrating an operation of a mobility soundgeneration apparatus according to various exemplary embodiments of thepresent invention.

Referring to FIG. 6, the mobility sound generation apparatus 100 or 300may determine whether there is a previous driving history in a locationin which the mobility is driving (S601).

For example, the mobility sound generation apparatus 100 or 300 maydetermine whether there is a previous driving history in a location inwhich the mobility is driving, through a mobility navigation system.

After determining whether there is a previous driving history in alocation in which the mobility is driving (S601), the mobility soundgeneration apparatus 100 or 300 may select a previous background soundas the background sound in a case where the mobility is driving in thesame driving path when it is determined that there is a previous drivinghistory in a location in which the mobility is driving (S602).

As an example, when it is determined that there is a previous drivinghistory in the location in which the mobility is driving, the mobilitysound generation apparatus 100 or 300 may determine that a drivinglandscape is similar to the previous driving landscape, and set theprevious sound background sound as the background sound.

After determining whether there is a previous driving history in alocation in which the mobility is driving (S601), the mobility soundgeneration apparatus 100 or 300 may determine which one occupies thelargest proportion based on the current location in the landscape in thedriving direction of the navigation map when it is determined that thereis no previous driving history in a location in which the mobility isdriving (S603).

As an example, the mobility sound generation apparatus 100 or 300 mayacquire information on a ratio of first category items seen in thelandscape in the driving direction through navigation map information.

The mobility sound generation apparatus 100 or 300 may determine whichone occupies the largest proportion based on the current location in thelandscape in the driving direction of the navigation map (S603), andthen set a background sound set according to the priorities of the arearatios (S604).

Although not shown, as various exemplary embodiments of the presentinvention, the mobility sound generation apparatus 100 or 300 may set abackground sound to a sound identical to or different from thebackground sound which has been selected previously in consideration ofa previous background sound in similar conditions when items ofdifferent categories among landscape items have a similar ratio based onthe current location.

For example, the mobility sound generation apparatus 100 or 300 may set,as a background sound, a sound corresponding to a first category itemoccupying the largest area, according to the priority of the area ratiosof the first category items, and mix the background sounds according tothe ratios.

The mobility sound generation apparatus 100 or 300 may select theprevious sound background sound as the background sound (S602), and thenidentify the current weather (S605).

The mobility sound generation apparatus 100 or 300 may identify thecurrent weather after setting the background sound set according to thearea ratio priority (S604).

For example, the mobility sound generation apparatus 100 or 300 mayidentify the current weather in an area in which the mobility is drivingthrough an AVN weather information system, identify the current weatherby analyzing an image acquired through the camera, or identify thecurrent weather by receiving information on the current weather throughthe server.

The mobility sound generation apparatus 100 or 300 may identify thecurrent weather (S605) and select an image corresponding to the weather(S606).

For example, the mobility sound generation apparatus 100 or 300 mayselect a pre-stored image representing the current weather incorrespondence with the current weather.

The mobility sound generation apparatus 100 or 300 may select anequalizer suitable for the image (S607) after selecting the imagecorresponding to the weather (S606).

For example, the mobility sound generation apparatus 100 or 300 mayperform an equalizer function by setting a ratio of the volume levels ofpreset frequency bands according to a ratio obtained by summing upenergy values for sectors of a new image obtained by performing Fouriertransform on an image corresponding to the weather.

After selecting the equalizer suitable for an image (S607), the mobilitysound generation apparatus 100 or 300 may determine whether a vehicle, aheterogeneous mobility, or a person exists in the vicinity of themobility (S608).

As an example, the mobility sound generation apparatus 100 or 300 mayperform image processing based on images acquired through camerasprovided in front portion and rear portion of the mobility to determinewhether other vehicles, heterogeneous mobility, or persons exist aroundthe mobility.

The mobility sound generation apparatus 100 or 300 may select a basicrhythm beat (S609) after determining whether a vehicle, a heterogeneousmobility, or a person exists in the vicinity of the mobility (S608).

For example, the mobility sound generation apparatus 100 or 300 mayselect a corresponding basic rhythm beat according to which of anothervehicle, a heterogeneous mobility, or a person is an object detected inthe vicinity of the mobility.

After selecting the basic rhythm beat (S609), the mobility soundgeneration apparatus 100 or 300 may set a beat speed corresponding tothe movement speed of the second category item (S610).

For example, the mobility sound generation apparatus 100 or 300 maydetermine a movement speed of the object detected in the vicinity ofmobility in real time, and set a beat speed according to the movementspeed of the object.

The mobility sound generation apparatus 100 or 300 may set a beat speedcorresponding to the movement speed of the second category item (S610),and then set a sound volume of the beat corresponding to the density ofthe second category item (S611).

For example, the mobility sound generation apparatus 100 or 300 maydetermine the density of objects detected in the vicinity of themobility in real time, and set the sound volume of the beat according tothe density of the objects.

The mobility sound generation apparatus 100 or 300 may generate a soundcorresponding to a landscape (S612) after setting the sound volume ofthe beat corresponding to the density of the second category item(S611).

The mobility sound generation apparatus 100 or 300 may generate a soundcorresponding to the background sound, the equalizer, the beat speed,and the sound volume, which are set according to the landscape whiledriving.

FIG. 7 is a flowchart of a mobility sound generation method according tovarious exemplary embodiments of the present invention.

Referring to FIG. 7, the mobility sound generation method may includeacquiring information on an outside landscape while driving of amobility (S710) and generating a sound corresponding to the informationon the landscape (S720).

In the mobility sound generation method, the acquiring of theinformation on the outside landscape while driving of the mobility(S710) may be performed by the information acquisition device 110.

As an example, the acquiring of the information on the outside landscapewhile driving of the mobility (S710) may include acquiring, by theinformation acquisition device 110, an external image through a cameraprovided in the mobility.

As various exemplary embodiments of the present invention, the acquiringof the information on the outside landscape while driving of themobility (S710) may include, determining information on the outsidelandscape based on map information of externals at a current locationwhen the information acquisition device 110 determines that navigationmap information is accurate.

As an example, the acquiring of the information on the outside landscapewhile driving of the mobility (S710) may include determining informationon external terrain based on the current location of the mobility atevery specific period set according to a speed or at every specificdriving distance of the mobility.

The generating of a sound corresponding to the information on thelandscape (S720) may be performed by the sound generation device 120.

For example, the generating of the sound corresponding to theinformation on the landscape (S720) may include setting a backgroundsound based on the ratio of a preset first category item occupying thelandscape.

For example, the generating of the sound corresponding to theinformation on the landscape (S720) may include determining, by thesound generation device 120, a ratio of the sound volumes for frequencybands based on a weather.

For example, the determining, by the sound generation device 120, theratio of the sound volumes for the frequency bands based on the weathermay include generating, by the sound generation device 120, an imagecorresponding to the weather and determining, by the sound generationdevice 120, the ratio of the sound volumes for the frequency bandscorresponding to the image.

As an example, the generating of the sound corresponding to theinformation on the landscape (S720) may include detecting, by the soundgeneration device 120, an image portion corresponding to a preset secondcategory item in an external image and generating, by the soundgeneration device 120, a beat according to the detected preset secondcategory item.

For example, the generating of the beat based on the detected presetsecond category item in the sound generation device 120 may includedetermining, by the sound generation device 120, a speed of the beataccording to a type of the detected preset second category item.

As an example, the generating of the beat based on the detected presetsecond category item in the sound generation device 120 may includedetermining, by the sound generation device 120, a sound volume of thebeat according to a density of the detected preset second category item.

For example, the generating of the sound corresponding to theinformation on the landscape (S720) may include setting, by the soundgeneration device 120, a background sound based on the background soundused in the previous driving, when it is determined based on navigationinformation of the mobility that a path through which the mobility is todrive includes a path through which the mobility has driven previously.

The operations of the method or the algorithm described in connectionwith the exemplary embodiments included herein may be embodied directlyin hardware or a software module executed by the processor, or in acombination thereof. The software module may reside on a storage medium(that is, the memory and/or the storage) such as a RAM, a flash memory,a ROM, an EPROM, an EEPROM, a register, a hard disk, a removable disk,and a CD-ROM.

The exemplary storage medium may be coupled to the processor, and theprocessor may read information out of the storage medium and may recordinformation in the storage medium. Alternatively, the storage medium maybe integrated with the processor. The processor and the storage mediummay reside in an application specific integrated circuit (ASIC). TheASIC may reside within a user terminal. In another case, the processorand the storage medium may reside in the user terminal as separatecomponents.

The above description is merely illustrative of the technical idea ofthe present invention, and various modifications and variations may bemade without departing from the essential characteristics of the presentinvention by those skilled in the art to which various exemplaryembodiments of the present invention pertains.

Accordingly, the exemplary embodiment disclosed in various exemplaryembodiments of the present invention is not intended to limit thetechnical idea of the present invention but to describe the presentinvention, and the scope of the technical idea of the present inventionis not limited by the embodiment. The scope of protection of the presentinvention should be interpreted by the following claims, and alltechnical ideas within the scope equivalent thereto should be construedas being included in the scope of the present invention.

The effects of the mobility sound generation apparatus and the methodthereof according to various exemplary embodiments of the presentinvention are provided as follows.

According to at least one of the exemplary embodiments of the presentinvention, it is possible to provide a mobility sound generationapparatus of generating a sound suitable for a landscape while drivingand a method thereof.

According to at least one of the exemplary embodiments of the presentinvention, it is possible to provide a mobility sound generationapparatus of generating a sound expressing weather while driving of amobility to enable an occupant of the mobility to recognize weatheroutside the mobility and a method thereof.

According to at least one of the exemplary embodiments of the presentinvention, it is possible to provide a mobility sound generationapparatus of generating and providing a sound corresponding to water,mountains, buildings, or the like forming a landscape outside themobility, expressing the landscape with the sound while driving togenerate a driving environment for facilitating an occupant to enjoy thelandscape, and a method thereof.

According to at least one of the exemplary embodiments of the presentinvention, it is possible to provide a mobility sound generationapparatus of dynamically expressing an external environment with soundby providing different sound beats according to mobility, bike, person,or the like existing in the vicinity of the mobility while driving and amethod thereof.

According to at least one of the exemplary embodiments of the presentinvention, it is possible to provide a mobility sound generationapparatus of generating tension while driving by expressing a degree ofcongestion around mobility with sound and a method thereof.

Furthermore, various effects may be provided that are directly orindirectly understood through the present invention.

For convenience in explanation and accurate definition in the appendedclaims, the terms “upper”, “lower”, “inner”, “outer”, “up”, “down”,“upwards”, “downwards”, “front”, “rear”, “back”, “inside”, “outside”,“inwardly”, “outwardly”, “interior”, “exterior”, “internal”, “external”,“forwards”, and “backwards” are used to describe features of theexemplary embodiments with reference to the positions of such featuresas displayed in the figures. It will be further understood that the term“connect” or its derivatives refer both to direct and indirectconnection.

The foregoing descriptions of specific exemplary embodiments of thepresent invention have been presented for purposes of illustration anddescription. They are not intended to be exhaustive or to limit thepresent invention to the precise forms disclosed, and obviously manymodifications and variations are possible in light of the aboveteachings. The exemplary embodiments were chosen and described toexplain certain principles of the present invention and their practicalapplication, to enable others skilled in the art to make and utilizevarious exemplary embodiments of the present invention, as well asvarious alternatives and modifications thereof. It is intended that thescope of the present invention be defined by the Claims appended heretoand their equivalents.

What is claimed is:
 1. A mobility sound generation apparatus comprising:an information acquisition device provided in a mobility to acquireinformation on an outside landscape of the mobility while driving of themobility; a sound generation device configured to generate a soundcorresponding to the information on the outside landscape; and a soundoutput device configured to output the generated sound.
 2. The mobilitysound generation apparatus of claim 1, wherein the informationacquisition device is configured to acquire the information on theoutside landscape though a navigation map of the mobility and at least acamera provided in the mobility.
 3. The mobility sound generationapparatus of claim 1, wherein the sound generation device is configuredto set a background sound based on a ratio of a landscape correspondingto a preset first category item in the outside landscape.
 4. Themobility sound generation apparatus of claim 3, wherein the preset firstcategory item includes at least one of mobility, buildings, water,persons and mountains.
 5. The mobility sound generation apparatus ofclaim 1, wherein the sound generation device is configured to determinea ratio of sound volumes for frequency bands based on a weather.
 6. Themobility sound generation apparatus of claim 5, wherein the soundgeneration device is configured to: generate an image corresponding tothe weather, and determine the ratio of sound volumes for frequencybands corresponding to the image.
 7. The mobility sound generationapparatus of claim 1, wherein the information acquisition device isconfigured to: acquire an external image through a camera provided inthe mobility, and wherein the sound generation device is configured todetect an image information corresponding to a preset second categoryitem in the external image, and generate a beat according to thedetected preset second category item.
 8. The mobility sound generationapparatus of claim 7, wherein the sound generation device is configuredto determine a speed of the beat according to a type of the detectedpreset second category item.
 9. The mobility sound generation apparatusof claim 7, wherein the sound generation device is configured todetermine a sound volume of the beat according to a density of thedetected preset second category item.
 10. The mobility sound generationapparatus of claim 7, wherein the preset second category item includesat least a vehicle, a heterogeneous mobility, and a person.
 11. Themobility sound generation apparatus of claim 1, wherein the soundgeneration device is configured to set a background sound based on abackground sound used in a previous driving when the sound generationdevice determines, based on navigation information of the mobility, thata path through which the mobility is to drive includes a path throughwhich the mobility has driven previously.
 12. A mobility soundgeneration method comprising: acquiring, by an information acquisitiondevice provided in a mobility, information on an outside landscape ofthe mobility while driving of the mobility; and generating, by the soundgeneration device, a sound corresponding to the information on theoutside landscape.
 13. The mobility sound generation method of claim 12,wherein the generating, by the sound generation device, of the soundcorresponding to the information on the outside landscape includessetting, by the sound generation device, a background sound based on aratio of a landscape corresponding to a preset first category item inthe outside landscape.
 14. The mobility sound generation method of claim12, wherein the generating, by the sound generation device, of the soundcorresponding to the information on the outside landscape includesdetermining, by the sound generation device, a ratio of sound volumesfor frequency bands based on a weather.
 15. The mobility soundgeneration method of claim 14, wherein the determining, by the soundgeneration device, of the ratio of sound volumes for frequency bandsbased on the weather includes: generating, by the sound generationdevice, an image corresponding to the weather; and determining, by thesound generation device, the ratio of sound volumes for frequency bandscorresponding to the image.
 16. The mobility sound generation method ofclaim 12, wherein the acquiring, by the information acquisition device,of the information on the outside landscape during the driving of themobility includes acquiring, by the information acquisition device, anexternal image through a camera provided in the mobility.
 17. Themobility sound generation method of claim 16, wherein the generating, bythe sound generation device, of the sound corresponding to theinformation on the outside landscape includes: detecting, by the soundgeneration device, an image information corresponding to a preset secondcategory item in the external image; and generating, by the soundgeneration device, a beat according to the detected preset secondcategory item.
 18. The mobility sound generation method of claim 17,wherein the generating of the beat based on the detected preset secondcategory item includes at least one of: generating, by the soundgeneration device, a speed of the beat according to a type of thedetected preset second category item; and determining, by the soundgeneration device, a sound volume of the beat according to a density ofthe detected preset second category item.
 19. The mobility soundgeneration method of claim 12, wherein the generating, by the soundgeneration device, of the sound corresponding to the information on theoutside landscape includes setting, by the sound generation device, abackground sound based on the background sound used in a previousdriving when the sound generation device determines based on navigationinformation of the mobility that a path through which the mobility is todrive includes a path through which the mobility has driven previously.